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Abstract 



The performance of elementary students was examined across 
grades using measures of reading* spelliig, and written expression. 
The measures were found to be sensitive to growth across grade 
levels. In addition, when the measures were administered ^o^tu- 
dents at ea&h grade 'level, at three different times during the aca r 
demlc year, similar within-grade trends were demonstrated, parti- 
cularly fin reading and spelling. The measures appear to be most 
sensitive to growth at grade levels one through four. Less consis- 
tent i growth was observed at grades five and six. 



An Analysis of Learning Trends in Simple Measures of Reading, 
Spelling, and Written Expression: A Longitudinal Study 

Considerable attention has been given to the assessment and in- 

i * * 

structioh of children with learning disabilities. With the advent of 
Public Law 94-142 (Federal Register, 1977) much of that attention' 
£ocuses on the evaluation of these children's academic skills. Jenkins, 
Deno, and Mirkin (1979) suggest that formative evaluation systems, 
which may be used continuously to measure the performance of ctuMren 
with- learning disabilities, also may provide viable alternatives to the 
traditibnal pre and post testing approach to evaluation of academic pro- 

0 

grams. Such systems allow the educator to closely monitor a child's 
progress, giving feedback .to both the teacher and the student during 
the ongoing process of instruction. Jenkins et' ai. argue that this con- 
tinual measurement and evaluation process .may be a key factor in the in-c 

structional program of the learning. disabled child. 

♦ 

Essential ^o the formative evaluation methodology is th'i use of 
measurement procedures that are valid, reliable, efficient, and sensitive 
to growth in various^ academic areas. These psychometric characteristics 

4 

have already been demonstrated for reading (Deno, Mirkin, & (Jhiang, in 
press), spelling (Deno, Mirkin, * Lowry, & Kuehnle, 1980), and written 
expression (Deno, Marston, & ifirkin, in press). In addition to deter- 
mining the technical adequacy of these measurement procedures, these 
studies confirm that increases in the scores obtained using these simple 
measurement procudure* are related to increases in grade level. Simply 
stated, third grade students read more words correctly p$r minute from 



2 

a word list and from basal, reading passages than do second graders. 

This prior research was /cross-sectional, however, and evidence 
of growth within grade levels over the course of the school year is 
necessary to substantiate these procedures as valid^for Use In mdnitor- 
ing'the educational progress of ..learning disabled students. In addi- 
tion, such data would provide standards by which teachers might judge 
student progress. The purpose of the present study was to gather this 
information for a group of elementary students measured at three differ- 
ent times during the ^ch^ul year: fall, winter, and spring. ; If the 
simple procedures for measuring reading, spelling, and written expres- 
sion are going to be used to monitor growth, we would hope to obtain 
consistent increases in student scores acrostf time. 

. Method 

\ 

Subj ects 

Fiftfy-eight children were randomly 'selected from the elementary 
schools of a small, midwestem city. The students ranged in, age from 
6 years, 4 months to 12 years, 3 months* The students were in grades 
one through six, with 13 first graders, 9 second gradets, 10 third 
graders, 7 fourth graders, 7 fifth graders, and 9 sixth graders. Twenty- 
eight of the students were males. None of the students were receiving 
I - 

special education services , \ 
Procedure 



The simple procedures usev? no evaluate students in reading/ spell- 
ing, and written egression were identical to the research materials used 
ii previous studies of reading (Deno, Mirkin, & Chiang, in press), spell- 
ing (Deno, Mirkin, Lovry, & Kuehnle, 19$0), and writing (Deno, Marstcn, 

ERIC * , 7 



& Mirfcin, in press) . For reading, each child was presented three word 

lists consisting of words randomly selected from the pre-primer through 

* * . * * 

third grade level of the flarris-Jaeqbson (1972) word list. The child 

was asked to read words aloud from each lisi for one minute. The number 
of words read correctly from a word list (WRCWL) was then tabulated for 
each list* Only the child's performance on the final list was used for 
the analysis. One minute oral reading rates were determined by the num- 
ber of "words ^ child read correctly from-an "oral passage" (WRCOP) : The 
stimulus -materials were selected randomly from three different third 
grade basal reading series: AlXyn-Sacon, Ginn 720, and Houghton-Mifflin. 
Again, oi\ly the third passage Score was used' in the analysis. 

Each subject's Spelling score was determined by thg dictation of 
words randomly selected from the, third grade level of the Har^is-Jacobson 
(1972) word list. Words were dicfatrBd to the students individually in 
two three-minute trials. Total words spelled correctly (WSC) and total 
number of letter sequences correct* (LSC) , as described by White and 
Haring (1976), were computed for each trial. Only the score on the 
second trial was employed in the analysis. 

Three written expression scores were obtained for each subject 
using compositipns written in response to two story starters (see Deno, 
Marston, & Mirkip, in press). Each composition was scored for words 
written and spelled correctly (WWC), letter sequences written correctly 
(LWC), and total words (TWW). Each child was given three minutes to 
write on each story started . The mean scores from both compositions 
were used for the analysis. 

Identical sets of the reading, spelling, and written expression 

a '. ' 

/ 



materials were administered in the fall, winter, and spring* Fall 
testing occurred during the third week of November, winter testing 

c a 

was conducted in the third week of February, and the spring testing 
occurred during the last week of April. 

All test protocols were scored by four undergraduate research 
assistants trained at the Institute for Research on Learning Disabili- 
ties.* Average interrater agreement exceeded .90 on ?11 academic ^ 
measures . *~ 

i 

Results 

Preliminary analysis of the dat^ centered on the mean performance 
of the entire group of elementary students for each academic measure. 
The mean performance on all seven measures for the fall, winter, and 
spring testing periods is presented in Table i. On all seven ^of. the , 
measures there was an increment in mean performance between the fall 
and winter test periods. Between the winter and spring testifigs, 
again all seven measures demonstrated another increase in performance, 
although the change in Words Spelled Correctly from the Story Starter 

does not appear to be practically different. 

I * 

Insert Table I about here 

In general, the growth curves or trends appear to be linear. To 
test this hypothesis that scores for each measure increase with age, 
the group means wire subjected to a repeated measures ANOVA for linear 
trend. As may be seen in Table 2* statistically significant F-ratios 
for linear trends were obtained for each of the seven measures. 
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Insert Table 2 about here 



A second analysis conducted^ on the data consisted of an examina- 

* * 

tion of mean performance of the elementary students by grade level. 
While sample sizes for each individual grade were small (ranging from 
7 ty> 13) and inferences may be unreliable, visual inspection of the 
grade level means is meaningful. Tables 3 to 9 reveal mean scores 
that demonstrate growth within the school year and across gradeo. 
When discrepancies occur, however, they usually appear to be related 
to the upper grade levels. Conversely, dramatic changes and growth 



frequently are ev 



ident in the lower grade levels. The means in Tables 



3 to 9 are graphed in Figures 1-7. 



4 . — 1 

Insert Tables 3-9 and Figures 1-7 about here 

A third approach to the analysis was the determination for each 
measure of the percentage of students at each grade leyel that in- 
creased their performance on each successive testing. The results in 
Table. 10 indicate that the largest percentages qf students who demon- 
strated growth on the academic measures for each session were enrolled 
in the lower grade levels./ In addition, student growth was most appar- 
ent in reading and spelling* 



Insert Table 10 about here 



Measuring studeftt performance in the fall, winter, and spring 
allowed us also to examine the average percentage growth on each 

10 . 



formative measure by grade level. Average percentage growth was 
determined by dividing the mean difference between fall and spring 
l>6rformance 'levels by mean performance in the fall. The average 
percentage growth rates for all measures by grade level and for the 
entire "sample are presented in Table 11. Again it appears the measures 
of reading and spelling were most sensitive to growth. Growth coeffj.- 
c ient s for these measures over nine months ratiged between a 9% increase 
and a 463% increase in performance. Percentage growth rates for the 
written expression measures ranged from .86 (a decrease in performance 
level) to 3.13 (a 213X increase)* ' 



\ . > 

* \ Insert Table 11 abqut here. 



- Discus sion 

- -■■ * 

The results of this trend analysis of seven academic measures pro- 
posed for use in formative evaluation systems support the notion .that 
the measures do indeed measure academic grdWth ov^r time. Most im- 
pressive were the reading and spelling measures which exhibited fairly 
steep continual, linear* increments or growth. The written expression 
measures did not fare quite as well, but Words Written Correctly and 
Tofcal Words Written appeared to increase as expected * 

In addition, to interpreting the data as suppdrt f or the simple 

measures 1 sensitivity to grpwth, two other observations are worth 

V 

mentioning. The inconsistency in mean performances at the upper - 

\ 

grade levels may mean there was a "ceiling effect" that influenced 
the grade level means, and auplpressed the growth' phenomenon. If true, 
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this would suggest that perhaps for some *fif tli and sixth graders 
evaluation would more appropriately be conducted using 'seventh or 

eighth grade level materials. • 

• ♦ 

The second observation concerns the immediate and dramatic growth 

i " ' 

seen at the earlier grade levels. The sensitivity of* £hese nwasures 
at these* stages suggests that they may be especially useful for eval- 
uating*the instructional programs, of learning disabled students, many 
of whom are functioning at similar levels. 
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(able I 

, * % 

ft 

Meat* Performance of 58 Elementary Stu^qts on Seven Normative 
Evaluation Measures during Fall, Winter, and Spring Testing 



Measure ~ Fall Winter Spring 

j ; j ._ 

Mean Number of Words Read 54.0 60.8 69.7 

Correctly from Word List (WRCWL) 

Mean Number of Words Read 94.9 111.0 129.9 

Correctly from Oral Passage (WgCOP) 

Mean Number of Words Spelled Cor- 15.2 17,9 20.3 

rectly from Dictated Word List (WSC) 

rfean, Number of Letters in Correct 1107.3 123.4 142.0 
Sequence from Dictated Word 
List (I-CS) 

Mean Number of Word-* Spelled 29.4 32.7 32.8 

. Correctly -on St . . ^arter (WWC) 

■>■" • . 

Mean Number of Letter Sequences 138.6 150.8 ^53.4 

Written Correctly on Story 



Starter (LWC) 

»an Numb er f of \ 
On Story Starter (TWW) 



Mean Number, of Wprda Written 31.9 '35.0 35.5 



10 



Table 2 

e 



Repeated Measure ANOVA's Test Ingr for Linear Trends on 
Fall 9 Winter, and Spring Data 



* F-value % for 
Measure ' Linear Trend Probability- 



Mean ffumber of Words Read ' A9.2 .0001 

Correctly from Word List 

Mean Number of Words Read 104.3 .0001 

Correctly from Oral^Paesage 

Mean Mumbe. cf Words Spelled 76.3 .0001 

Correctly from Dictated Word List 

- \ 



Mean Number of Letters in Correct 102.9 .0001 

Sequence from Dictated Word List 

Mean Number of Words Spelled 10.7 .0018 ' 

Correctly on Story Starter 

Mean Number of Letter Sequences 9 8.6 .0041 

Written Correctly on Story Starter 

Mean Number of Words Written 10.1 .0024 

on Story Starter > 
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Table 3 

\ 



Mean Number of Words Read Correctly from Word List for 
Pali, Winter, and Spring by Grade Lev^l t 



r Grade 



/ 9 



Tall Winter Spring 



1 4.7 10.3 l ^16.5 

2 37.1 57.1 68,* 

3 57.1 63.8 71.7 
4 \ 74.0 —^72.0 9*M> 

5 81»4 79.7 92.9 

6 88.1 . 99.7 106.2 
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Table 4 

Mean Number of Words Read Correctly from Oval Passage for 
Pall, Winter, and Spring "by Grade Level 



Grade 


Fall 


* Winter 


Spring 


1 


18.3 


31.1 * 


45*. 7 


2 


73.2 


101. 1 


127.8 


3 


..-106.3 • 


, 123.6 


136.2 


4 . 

> 


y 5 .4 


131.7 


155.3 


5 


125.7 


147.3 


161.1 


6 


142.9 


176. '7 


182.8 
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. Table 5 

Mean Number of Words Spelled Correctly on Dictated Word List for 
Fall', Winter, and Spring by Grade Level 



Gradfc 


Pall 


Winter 


Spring 


1 


.8 


2.8 


4.5 


2 


9.0 


11.5 


16.9 






/ 




3 


13.9 


18.8 


17.7 


4 


H 20.3 


22.6 


25.4 " 


5 


22.4 


22.7 


26.5 


6 


30.2 


33.6 


36.2- 




* 
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Table 6 

Mean Nuaoer of Letters in Correct Sequence on Dictated 

* 

.Word List for FaM., Winter, and Spring by Grade Level 



i 

Grade 


Fall 


; y 

Winter 


Hp 

Spring * 


1 


L3.1 


31.2 


45.7" 0 - 


2 


77.3 


94.3 


.; 124.8 " 


3 


98.7 


129.4 


* 

\124.9 


4 


1*8.1 


149.7 


168.1 




159.7 . 


158.0 


176.8 . 


6 


198.1 


206.6 


. 246.8 



Table 7 ; 
Mean Number of Words Spelled Correctly on a Story Starter for 
Fall, Winter, and Spring by Grade Level 



- J ^<~ 

Grade 


Fall 


, Winter 


Spring 


1 


4.2 


8.0 


11.2 


2 


16.4 


20.9 


22.6 


3 


28.9 


32.8 


- 25.0 


4 


35.7 


36.5 


39.1 


5 


42.4 


47.4 


45.0 


6 


, 56.0 


-57.0 . 


55.4 



• \ 

•v 

/ ' ' , , 

. / 

p 

I 

\ 
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Table 8 

Mean Number of Letters Written in Correct Se^bence on a Story 
Starter f6r Fall, Winter, and' Spring by Grade Level 



\ 



Grade * Fall Winter Spring 



1 16.7 33:4 52.3 

2 ^ 78.4 ,97,2 * - 104.3 

3 137.1 v 132.2 118,7 

4 167.5 167.8 181.1 

5 ,200.0 224.8 182.5 

6 267*4. 265.3 ' 266.7 



Table 9/ 

Mean Number of Words Written on a Story . Starter for 
Fall, Winter, and Spring by Grade Level 



Grade 



Fall 



Winter 



Spring 



5.1 
20.6 
31.7 
38.7 
A7.0 
58.6 



9.5 
24.2 
34.5 
39.7 
50.7 
58.5 



14.5 
26.2 
27.4 
41.7 
47.1 
57.9 
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Table 10 

Percentage of Students Who Increased Their Performance from 
Fall to Winter to Spring on Seven Measures of 
Reading, Spelling, and Writing , 



sasure 



Entire 

Grade 1 Grade 2 Grade 3 Grade A Grade 5 Grade 6 Sample 
(N-13) (N-9) (N-10) (N-7) (N-7) (N-9) (N-58) 



Words Read Correctly 
* on Word List 



Words Read Correctly 
from Oral Passage 

Words Spelled Correctly 
from Dictated List 

Letter Sequences Correct 
oh Story Starter 

Total ^ords Written 
on Story Starter 

Words Spelled Correctly 
on Story Starter 

Letter Sequences Correct 
on Story Starter 



76.9 
84.6 
69.2 
84.6 
46.2 
A6.2 
53.8 



88.9 
100.0 
88.9 
77.8 
33.3 
33.3 
33.3 



80.0 28\6 28.6 
70.0 71.4 42.9 
30.0 57.1 ^.6 



44,. 4 58.6 

t 

-* • 

55.6 • 69.0 

66.7 56.9 



50.Q 71.4 42.9 66.7 65.5 



0.0 14.3 14.3 22.2 24.1 



6.0 14.3 14.3 22.2 24.1 
10,0 14.3 14.3 11.1 25.9 



«)'J 



\ Tabl* 11 \ 
Average Percentage Growth for Each Grade Level and Entire Sample on 
Formative Measures of Reading, Spelling, and Writing* 



1 

Measure 


(N-13) 


UiClQC t. 

(N-9) 


Grade 3 
(N-10) 


* 

GraHp L 
, (N-7) 


Grade 5 
(N-7) 


Grade 6 
(N-9) 


Entire 
Sample 
(N-58) 


( 

Wofds Read Correctly* 
on Word List 


251 


84 




9 • 


14 


21 


29 


Words Read forrectly 
from Oral Passage 


150 


A 

• 75 


26 . 


24 


28 


30 


37. 


Words Spelled' Correctly 
from Dictated List 


463 


88 


27 


25 


18 


20 


34 


Letter Sequences Correct 
on Story Starter 


249 


61 


27 


22 


11 


25 


32 


Total Words Written 
on Story Starter 


184 ' 


27 


✓ 
-14 


8 


0 


-1 


• 12 


Words Spelled Correctly 
on Story Starter 


167 


38 


-13 


10 


\ 


-1 


13 


Letter Sequences Correct 
- on Story Startfer * 


213 


33 


-13 


8 


-9 


-1 


y 11 

• 



♦Percentages with negative signs represent the average percentage decrease. 
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Fall Winter Spring 



Figure 1* Mean Nuaben of Horde Read Correctly from Word Liet 
for Fall, Winter , and Spring by Grade Level. 
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Figure 2. Mean Number of W6rd» Read Correctly from Oral Passage 
, for HlX% Winter, and Spiring by Grade Level. ^ 



26 



22 



30 



20 ' 



10 




Fall 



Winter 



Grade 6 



Grade 5 
Grade 4 



# Grade 3 



> Grade 2 



Grade 1 



Spring 



Figure 3. tfean Number of Words Spelled Correctly on Dictated Word 
List for Fail, Winter, and Spring by Grade Level. 
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Figure 5. Kaan Nuaber of Words Spelled Correctly on a Story Starter 
for Fall, Winter, and Spring by Grade Level.. 
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Figure 6. Mean Nuaber of ..enters Written in Correct Sequence on a 

Story Starter for Tall, Winter, and Spring by Grade Level. 
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